Llion Jones, CTO of Sakana AI and co-author of the influential transformer paper, expressed concerns at the TED AI conference about the stagnation in AI research due to an overwhelming focus on transformer architecture. He argues that the pressure for quick returns and competitive research has stifled creativity, preventing the exploration of potentially groundbreaking innovations in the field. Jones is now seeking to shift away from transformers in pursuit of the next big advancement in AI.